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(g) Airborne obstacle collision avoidance apparatus. 



(§7) An airborne obstacle collision avoidance ap- 
paratus which includes an object sensor for 
sensing objects within a field of view of the 
aircraft and an aircraft navigation system for 
navigating the aircraft through space. The ap- 
paratus also includes a signal processor for 
receiving data from both the object sensor and 
the aircraft navigation system, for generating 
map data of the objects within the field of view 
of the aircraft, for dynamically changing the 
map data as the aircraft moves through space 
and for determining the probability that the 
aircraft is on a collision course with respect to 
each sensed object. The apparatus further in- 
cludes an alarm which is activated when the 
signal processor detemnines that there is a high 
probability that the current aircraft flight direc- 
tion is on a collision course with respect to a 
sensed object. 
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FIELD AND BACKGROUND OF THE INVENTION 

The present invention relates to airborne obsta- 
cle collision avoidance apparatus. The invention is 
particularly applicable in apparatus for avoiding low- 
flying hazards such as cables, which are particularly 
hazardous for helicopters, but the invention may be 
used for avoiding other types of obstacles, such as 
hills, sand dunes or other terrain fornnations, other 
aircraft, etc. 

Direct vision is frequently not sufficient to avoid 
collisions with objects, and many obstacle collision 
avoidance systenns have been designed for this pur- 
pose. However, the problem has become particularly 
serious for helicopters since, even under good condi- 
tions with trained users and with the aid of night vision 
devices, direct vision cannot always reveal power 
lines, sand dunes, telephone poles, and other such 
hazards to low flying aircraft. 

OBJECTS AND BRIEF SUMMARY OF THE 
INVENTION 

According to the present invention, there is pro- 
vided an airborne obstacle collision avoidance appa- 
ratus, comprising: object sensor means for sensing 
objects within a field of view of the aircraft; an aircraft 
navigation system for navigating the aircraft through 
space; signal processing means for receiving data 
from both the object sensor means and the aircraft 
navigation system, for generating map data of the ob- 
jects within the field of view of the aircraft, for dynam- 
ically changing said map data as the aircraft moves 
through space, and for determining the probability 
that the aircraft is on a collision course with respect 
to each sensed object; and alarm means for produc- 
ing an alarm when the signal processing means de- 
termines there is a high probability that the current 
aircraft flight direction is on a collision course with re- 
spect to a sensed object. 

In the preferred embodiment of the invention de- 
scribed below, the aircraft navigation system is an in- 
ertial navigation system. 

According to further features in the described 
preferred embodiment, the alarm means includes a 
visual display, and display control means for visually 
displaying thereon the sensed objects and an indica- 
tion of their probabilities of being located on a colli- 
sion course with respect to the current flight direction 
of the aircraft. In addition, the display control means 
visually displays: in a first color, objects at a relatively 
large distance from the aircraft; in a second color, ob- 
jects that will become a danger of collision if no cor- 
rective action is taken; and in a third color, objects 
which represent a danger to the aircraft and require 
corrective action. 

According to still further features in the descri- 
bed preferred embodiment, the display control 



means also visually displays the range of each detect- 
ed object having a high probability of being located on 
a collision course with respect to the current flight di- 
rection; it also displays azimuth and elevation, with 
5 respect to the current flight direction, of each detect- 
ed object having a high probability of being located on 
a collision course with respect to the current flight di- 
rection. 

According to still further features in the descri- 

10 bed preferred embodiment, the display control 
means displays, in full lines, the sensed objects hav- 
ing a high probability of being located on a collision 
course with respect to the current flight direction, and 
in broken lines, spaced at a distance from the full lines 

15 of the sensed objects, an uncertainty region caused 
by measurement noise and disturbances. 

According to still further features in the descri- 
bed preferred embodiment, the apparatus further in- 
cludes guidance command generator means for gen- 

20 erating an emergency escape flight guidance path, 
and for displaying the escape path to the pilot, in the 
event the signal processing means determines there 
is a danger of an imminent collision with an object. 
Further features and advantages of the invention 

25 will be apparent from the description below. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The invention is herein described, by way of ex- 
30 ample only, with reference to the accompanying 
drawings, wherein: 

Fig. 1 is a block diagram illustrating one form of 
airborne obstacle collision avoidance apparatus 
in accordance with the present invention; 
35 Fig. 2 is a block diagram more particularly illus- 

trating some of the main components in the ap- 
paratus of Fig. 1; 

Figs. 3 and 4a-4e are diagrams illustrating the 
geometry of the protected region; 

40 Fig. 5 is a block diagram more particularly illus- 

trating the electro-optical laser sensor in the ap- 
paratus of Figs. 1 and 2; 
Figs. 6a-6d illustrate various scanner arrange- 
ments which may be used in the electro-optical 

45 laser sensor; 

Fig. 7a illustrates the scanner pattern with re- 
spect to a cable obstacle in the aircraft field of 
view, and Fig. 7b illustrates the bitmap produced, 
after filtering, as a result of scanning the cable of 

50 Fig. 3; and Fig. 7c illustrates a typical scan as a 

result of scanning the cable of Fig. 3 by a saw- 
tooth scanning pattern; 

Fig. 8 is a blockdiagram illustrating operations of 
the signal processing system in the apparatus of 
55 Figs. 1 and 2; 

Figs. 9 and 9a are flow charts more particularly 

illustrating the operation of Fig. 8; 

Figs. 10-12 are diagrams further illustrating op- 
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erations of the signal processing system; 
Fig. 13 is a fiow chart illustrating the operation of 
the alarm decision system in the apparatus of 
Figs. 1 and 2; 

Fig. 14 is a block diagram more particularly illus- 5 
trating the audio-visual alarm system; 
Figs. 15 and 16 illustrate the format of the dis- 
play, and a display image, respectively, in the ap- 
paratus of Figs. 1 and 2; 

Fig. 17 is a block diagram illustrating the guid- io 
ance command generator system; and 
Fig. 18 illustrates an example of how an escape 
path is generated upon determining that the air- 
craft is on a collision course with a sensed obsta- 
cle. 15 

DESCRIPTION OF A PREFERRED EMBODIMENT 

The Overall System 

20 

The apparatus illustrated in the drawings is de- 
signed to sense a cable or other obstacle in a protect- 
ed region within the field of view of the aircraft while 
travelling through space and to estimate the future 
position with respect to the sensed obstacle and the 25 
collision probability. If the apparatus determines 
there is a high probability that the aircraft is on a col- 
lision course with respect to a sensed obstacle, the 
apparatus also functions to generate alarm signals to 
the aircraft pilot and collision avoiding flight com- 30 
mands to the aircraft autopilot. 

The obstacles can be cables as well as other ob- 
jects, such as terrain formations and other aircraft, 
which may constitute obstacles to the aircraft equip- 
ped with the system. 35 

As shown in Fig. 1 , the illustrated apparatus may 
include two types of obstacle sensors: an electro- 
optical laser sensor 3, and an optional electromag- 
netic cable sensor 4. 

The electro-optical laser sensor 3 transmits a 40 
laser beam and receives the beam reflected by an ob- 
ject in the line of sight of the laser beam. Sensor 3 
measures the time-of-f light and the intensity of the 
returned laser signal corresponding to a given angu- 
lar position of the laser beam, and calculates the 45 
range by multiplying one-half the time of flight by the 
light speed. The laser beam is deflected by a 2-D 
scanning system 6, e.g., a rotating mirror, prism or 
any other scanning device. The scanning system 6 
generates a pattern such that the light beam covers so 
an angular region defined by a horizontal field of view 
and a vertical field of view as described more partic- 
ularly below with respect to Figs. 3 and 4. 

The output of the scanner system 6 are 3-D im- 
ages of both range and intensity in the field of view 55 
of the aircraft. These images from sensor 3, together 
with data from the electromagnetic cable sensor 4, 
are fed into a signal processing system 8, which also 



generates a map of the objects within the field of view 
of the aircraft. 

It will be appreciated that the generated map con- 
tinuously changes with respect to both range and in- 
tensity because of the movements of the aircraft. The 
range and intensity are dynamically updated by the 
signal processing system 8 by using data of the dy- 
namic movements of the aircraft measured by the in- 
ertial navigation system 10 of the aircraft. 

The output of the signal processing system 8 is a 
list of objects in the protected region, as well as the 
3-D composite range- intensity image to be displayed 
to the pilot. 

The list of objects contain data concerning the 
relative position (space and time) of each object with 
respect to the aircraft. This list is fed to an alarm de- 
cision system 12, which generates, for each object in 
the list, a condition status or warning concerning the 
danger of collision of the respective object by the pro- 
tected aircraft. 

The 3-D range-intensity images from the signal 
processing system 8 are also fed to an audio-visual 
alarm system 14 which displays the images to the pi- 
lot. Those objects representing a real collision danger 
obstacle are emphasized on the display in different 
colors, each color corresponding to a different alarm 
level, for example: yellow, for obstacles still at a dis- 
tance; green, for obstacles becoming a danger if no 
correcting action is taken; red, for obstacles which 
endanger the aircraft and should be overcome; and 
blinking red, for obstacles which must be overcome by 
an immediate escape sequence. 

The illustrated system further includes a guid- 
ance command generator system 16. This system re- 
ceives both the data from the signal processing sys- 
tem 8, and also the alarm status from the alarm de- 
cision system 12, and body angles from the inertial 
navigation system 10. If an imminent danger is pres- 
ent, meaning that at the current velocity and heading 
of the aircraft a collision is certain in a short time with 
respect to the pilot response time, the guidance com- 
mand generator system 16 generates an emergency 
escape flight guidance command to the autopilot, and 
a strong audio-visual warning display to the pilot. The 
pilot may accept the command and validate it, or may 
override the command with manual flight commands 
to avoid the obstacle and to stop the warning signals. 

Fig. 2 more particularly illustrates the structure 
of the alarm decision system 12, the audio-visual 
alarm system 14, and the guidance command gener- 
ator system 16. 

As described earlier, the signal processing sys- 
tem 8 produces dynamically-updated 3-D composite 
range-intensity images of the protected region as 
sensed by the laser sensor 3 (Fig. 1), and the cable 
sensor 4. These are hybrid images combining range 
and intensity data. These images are not dependent 
on the day/night conditions, so they have to be adapt- 
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ed for display in any condition. 

This 3-D composite range-intensity images from 
the signai processing system 8 are fed to a video im- 
age generator 121, and to a logic decision block 122 
in the alarm decision system 12. The video image 5 
generator 121 generates 2-D pixel images. These are 
fed to a video mixer 141 in the audio-visual alarm sys- 
tem 14, to be displayed to the pi lot via the aircraft dis- 
play 142 in the latter system only if there is any infor- 
mation to be displayed, i.e., if the list of obstacles is io 
not empty. The decision as to the existence of infor- 
mation to be displayed is made by the logic decision 
block 122 in the alarm decision system 12. The latter 
block outputs an enable signal to the video image 
generator 121 wheneverthe list of objects supplied by 15 
the signal processing system 8 includes at least one 
obstacle which represents a danger to the protected 
aircraft. The logic decision block 122 also generates 
a warning signal fed to the aircraft displays 1 42 in the 
audiovisual alarm system 14 for displaying theobsta- 20 
cle to the pilot. The display is color-coded as descri- 
bed earlier to indicate the respective alarm level rep- 
resented by the detected obstacle. 

The logic decision block 122 in the alarm decision 
system 12 also controls an obstacle map generator 25 
161 in the guidance command generator system 16. 
Generator 161 also receives the 3-D composite 
range-intensity image from the signal processing 
system 8, and also the actual position data of the air- 
craft from the inert iai navigation system 1 0. Based on 30 
this data, the obstacle map generator 161 generates 
the map of the obstacles from the list generated by 
the signal processing system 8. This map is projected 
on the horizontal plane for displaying it on a moving 
map display, if such a display is available (for helicop- 35 
ters). Also displayed are possible escape paths for 
each obstacle of the list, as generated by an obstacle 
avoid command generator 162. 

If the logic decision block 122 in the alarm deci- 
sion system 12 determines that one of the obstacles 40 
is a real danger, it causes the obstacle map generator 
161 and the obstacle avoid command generator 162 
to calculate flight guidance commands for the aircraft 
to follow in an escape path. These are automatically 
applied to the autopilot, and also to the aircraft dis- 45 
plays 142 to serve as a warning to the pilot: However, 
the pilot must first validate the flight guidance com- 
mands displayed by the aircraft display 142 before 
they will be automatically implemented to avoid the 
obstacle. so 

The other displays in the aircraft (e.g., FLIR) are 
indicated by box 18 in Fig. 2. These other displays are 
combined with the 3-D range-intensity image from 
the signal processing system 8, via the video image 
generator 121, and a composite image is generated 55 
by the video mixer 141 and fed to the pilot via the air- 
craft displays 142, together with the warning signals 
generated by the logic decision block 122, and the 



guidance commands generated by the obstacle avoid 
command generator 162. 

The Geometry of the Protected Region 

Fig. 3 is a 3-D isometric representation of the pro- 
tected region, schematically indicated at 20; whereas 
Figs. 4a, 4b and 4c represent the projections of the 
protected region onto the vertical, horizontal and 
frontal planes, respectively. The pilot's line-of-sight 
position is represented by broken line 21 passing 
through a marking (cross) 22 on the display. Both the 
line-of-sight 21 and the marking 22 move together 
with the aircraft coordinate system 26 such that the 
protected region 20 is fixed with respect to the aircraft 
but contains obstacles which are fixed with respect to 
the horizon coordinate system 27. 

For example, illustrated in Fig. 3 are two obsta- 
cles in the form of a first cable and a second cable 
C2 having different spatial positions in the protected 
region 20 and moving in different directions relative 
to the coordinate system 23 of the protected aircraft. 

The positions of the obstacles are represented in 
the aircraft coordinate system (the center of which is 
at 23), as defined by the aircraft inertial navigation 
system 1 0, as (Xa,ya,Za), with the center at point 23 on 
the aircraft. The obstacles are standing or moving ob- 
jects, having an absolute position with respect to the 
horizon coordinate system 27 (Xh,yh,Zh) with the cen- 
ter at point 23 in Fig. 3; i.e., the standing objects move 
relatively to the aircraft with the same dynamics as 
the aircraft with respect to the world coordinate sys- 
tem, such as LLLN (Local Level Local North). 

The position of a cable with respect to the aircraft 
is defined by the range to the closest point on the 
cable, indicated as "A" in Figs. 4a-4c, and the three 
angles AZ, EL and DP. The frontal projection illustrat- 
ed in Fig. 4c shows the image seen by the pilot. For 
example, the pilot sees cable Ci at angular position 
AZ, EL, with respect to his line of sight 21, which is 
identical with the heading of the aircraft as measured 
by the inertial navigation system 10 (Fig. 1) located 
at the center 23 of the aircraft coordinate system. 

In order to avoid an obstacle, the marking 22 on 
the display must be away from the point A, the point 
on the obstacle nearest to the aircraft. If the marking 
22 is on point A and no change in the course is made, 
the aircraft will collide with the cable at point A. In or- 
der to avoid the collision, the pilot must fly the aircraft 
such that the marking 22 will be as far away as pos- 
sible from point A; that is, the distances AZ and EL 
(Fig. 4c) should be larger than a minimum value cor- 
responding to the size of the aircraft and its move- 
ment disturbances. 

If the obstacles are outside the angular region de- 
fined by the horizontal field of view (represented by 
distance 24 in Fig. 3) and the vertical field of view 
(represented by distance 25 in Fig. 3), the obstacle is 
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irrelevant to the pilot. 
The Sensors 3 and 4 

As shown in Fig. 1 , the system includes two types 
of sensors, namely an electro-optical laser sensor 3, 
and an electromagnetic cable sensor 4. The laser 
sensor 3 is an active one, operating in the RF or in the 
millimeter spectrum, and transmits laser beams in 
the direction of the movement of the aircraft to detect 
dangerous obstacles in its course of travel. The elec- 
tromagnetic cable sensor 4 may be an active sensor 
or a passive sensor. An active sensor operates in the 
RF or millimeter spectrum and illuminates the pro- 
tected area. A passive sensor receives the electro- 
magnetic energy produced by current flowing 
through an electric cable. 

The objective of the system is to sense any ob- 
stacles in the travelling direction by at least one of the 
above sensors in order to alert the pilot to take eva- 
sive action to avoid a collision. By using the two dif- 
ferent types of sensors, operating according to two 
different techniques, there is an increase in the prob- 
ability of detection and a reduction in the probability 
of false alarms. 

The laser sensor 3 is attached as a rigid body to 
the aircraft (helicopter or other airborne unit) which 
serves as a platform. It has a global field of view 
(GFOV) constituted of the HFOV (horizontal field of 
view) and the VFOV (vertical field of view), which may 
have the following values: 

HFOV -50 to 60 deg. 
VFOV - 20 to 40 deg. 

fs = 5 to 20 FOV/sec {scanning rate, number of 
FOV per second} 

The complete region is illuminated by the sensor 
devices in order to detect the obstacles. 

The instantaneous field of view (IFOV) is smaller 
than the GFOV, as shown in Fig.4d, in such a way that 
the IFOV continuously adjusts the values of the para- 
meters HIFOV (instantaneous HFOV) and VIFOV (in- 
stantaneous VFOV) based on the flight conditions, 
velocity, acceleration and height. In this manner, an 
adaptive FOV value is achieved, so that the IFOV is 
scanned rather than the GFOV. This technique en- 
ables the scanning rate to be increased. In Fig. 4d: 
Oq is the center of GFOV; and 
Oi is the center of IFOV and is dynamically aimed 
with respect to Og. 

As shown in Fig. 4e, the global line-of-sight (G- 
LOS) is the line of sight of GFOV which has the center 
at Oq. The instantaneous line-of-sight (l-LOS) is the 
LOS of IFOV. In this manner, the angle t| is changed 
according to well known adaption rules in order to in- 
crease the scanning rate, and therefore the probabil- 
ity of detection. 

Fig. 5 is a block diagram illustrating the compo- 
nents of the electro-optical laser sensor system 3. 



Thus, the laser sensor system 3 includes a central 
processing unit CPU which generates pulses sup- 
plied via a pulse shaping circuit 30 and a drive 31 to 
a laser diode (a single diode or an array of diodes) 

5 transmitter 32. The laser pulses are transmitted via a 
scanner and optic unit, schematically indicated at 33, 
which includes not only the scanner system 6 (Fig. 1), 
but also the necessary optics to colli mate and direct 
the photonic energy to the monitored area, to receive 

10 the photonic energy reflected therefrom and to direct 
it to the receiver diodes 34. The received energy is 
amplified in an amplifier 35 and fed via a range gate 
36 and a buffer and A-D converter 37, back to the 
GPU. The foregoing operations are synchronized by 

15 synchronizer 38. 

Fig. 5 also illustrates the powersupply 39 for con- 
trolling the various units of the laser sensor 3. The in- 
strumentation block 40 illustrated in Fig. 5 refers to 
all the instruments that the aircraft platform (helicop- 

20 ter or other airborne unit) Includes, such as the Iner- 
tial navigation system 10 (Fig. 1), vertical and other 
gyros, magnetometer, altitude reference unit, velocity 
meter, GPS (Global Positioning System) unit, etc. 
The scanner, included in unit 33 in Fig. 5 or the 

25 scanner illustrated at 6 in Fig. 1 , may be a convention- 
al electromechanical scanner including a motor that 
can deflect a mirror or prism to any desired direction 
in order to transmit the photonic energy to the moni- 
tored region in front of the aircraft, and to receive the 

30 photonic energy reflected from objects in that region. 
Figs. 6a-6d illustrate four types of scanning patterns 
that may be used: a raster scan in Fig. 6a, a conical 
scan in Fig. 6b, a saw-tooth scan in Fig. 6c, and a spi- 
ral scan in Fig. 6d. 

35 The output of the receiver 34 (Fig. 1 ) is arranged 

to create a bit map of the objects within the scanned 
field of view. Fig. 7a illustrates an object, namely 
cable Ci being scanned by a saw-tooth scan pattern 
SP. The information received by the receiver 34, as a 

40 result of scanning the cable Ci, is fed to the signal 
processing system 8, as described earlier, where it is 
modified by the information from the inertial naviga- 
tion system 1 0 according to the dynamically changing 
characteristics of the aircraft as it moves through 

45 space. Fig. 7b illustrates the bit map produced as a 
result of scanning the cable Gi (Fig. 7a) after filtering, 
and modification by the inertial navigation system 
10. 

Preferably, the cable will be scanned at least five 
50 times in each frame. Fig. 7c illustrates an example 
when using a saw-tooth pattern. The Signal Process- 
ing System 8 

As indicated earlier, the signal processing system 
8 receives the outputs of the two sensors 3, 4 and 
55 produces a composite map of all the potential obsta- 
cles that relate to the field of view of the aircraft as de- 
tected by these sensors; it also receives data from the 
aircraft inertial navigation system 1 0 and dynamically 
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changes the generated map of the obstacles as the 
aircraft moves through space. 

The signal processing system 8 operates accord- 
ing to the following phases, as illustrated by the block 
diagram of Fig. 8. 5 

First, the data from the two sensors 3, 4, from the 
aircraft Inertial navigation system 10, and from other 
instrumentation in the aircraft (all schematically indi- 
cated by block 40 in Fig. 8 and as described above 
with respect to Fig. 5) is used for creating a bit map io 
of all the objects in the field of view detected by the 
two sensors 3, 4. This data is dynamically updated by 
the aircraft inertial navigation system 10 as the air- 
craft moves through space, as indicated by block 41 
in Fig. 8 and as described below with respect to the 15 
flow charts of Figs. 9 and 9a. 

This data is then filtered, as indicated by block 
42, to output potential features which have to be fur- 
ther analyzed. 

These potential features are subjected to a con- 20 
tour/terrain extraction operation to define where is 
the boundary between the ground and the flight 
space with respect to the inertial or body reference 
frame. This operation is performed in block 43 which 
may also receive data from a digital terrain map 25 
(DTM), as shown by block 44. In addition, the poten- 
tial features from block 42 are subjected to a straight 
line extraction operation indicated by block. 45, in or- 
der to define the location of the obstacle, e.g., the 
electric cables and/or the poles that hold them per- 30 
pendicular to the terrain contour. 

A determination is then made as to the parame- 
ters of the obstacles and also the probability/uncer- 
tainty of collision with the obstacles, as indicated by 
box 46 In Fig. 8. This determination is aided by input- 35 
ted data relating to the various obstacles expected to 
be encountered, as indicated by box 47 in Fig. 8. 

Fig. 9 is a flow chart illustrating the generation of 
the bit map as described above with respect to Fig. 8, 
and Fig. 9a more particularly illustrates the geomet- 40 
ric transformation operation of Fig. 9, in which the 
data from the two sensors 3 and 4 is dynamically up- 
dated according to the movements of the aircraft as 
determined by the inertial navigation system 10. 

Thus, in order to achieve good matching and in- 45 
teg ration between samples of the environment (which 
includes the obstacles, e.g., the cable) at different 
times, positions and orientations of the aircraft, the 
output of the inertial navigation system 10 is periodi- 
cally sampled to provide data regarding the incremen- so 
tal changes in the position and orientation of the air- 
craft. Thus, as seen in Fig. 8, each sampled frame in- 
cludes all the information available by that time. The 
dynamic updating operation "propagates" this frame 
in time in order that it will be correct and coherent with 55 
the next sampled frame. Figs. 9 and 9a illustrate how 
this is done. 

Fig. 9a illustrates the outputs of the inertial nav- 



igation system 1 0 as being a function of P, V, a and 
(0, wherein: 

P - position 

V - velocity 

a- orientation/attitude 

&- angular velocity 
At moment k, there is an estimate map M(tk/t|<) 
based on all the information till time k (box 50). At 
time k+1, there is a different value of INS system 10 
output, Xk+1. The increment from the previous sam- 
pling is 6Xk+i so that the map is updated based on the 
changes in INS outputs (boxes 51 and 52). 

For example: if the distance to the obstacle was 
200 meters, and it was parallel to the ground, the 
change in the vehicle position (§Xk+i) was 20 meters; 
therefore, in the predicted (updated) map the distance 
at time tk+i will be changed to 180 meters. 

In the same way, the distance and the orientation 
of all the map objects are updated from the previous 
state. 

Fig. 10 illustrates the straight line extraction op- 
eration (block 45) in the blockdiagramof Fig. 8. Since 
one of the obstacles of particular interest desired to 
be detected by the system is a cable, the system will 
include a "straight line extraction" filter to extract any 
straight lines from the bit map generated by the signal 
processor system 8. 

The filter search for straight line matching in the 
image-bit map may be based on well known rules for 
minimizing errors between a sampled image and a 
desired feature. For example, the MMS (minimum 
mean square) or LMS (least mean square) rule may 
be used for this purpose. 

The square dots in Fig. 10 illustrate potential fea- 
tures within the field of view, and the straight line in- 
dicates a filtered line. The objective is to minimize the 
error between the filtered (straight) line and the po- 
tential (square dot) features. 

The filtered line shown in Fig. 10 may also be 
based on predetermined rules that characterize elec- 
trical cables in the field and introduced, e.g., by block 
44. Such rules, for example, may relate to: 

1 . the slope of the cable with respect to the con- 
tour/terrain; 

2. the minimum and maximum height of the cable 
above the terrain; 

3. the minimum length of the cable if not on the 
boundary of the image; 

4. the maximum number of cables in a single 
frame; and/or 

5. the continuity of the existence of a cable in suc- 
cessive frames. 

Fig. 11a illustrates the operation performed by 
blocks 46 and 47 (Fig. 8) in the signal processing sys- 
tem 8 of predicting and ranking the obstacles detect- 
ed. These operations are schematically indicated by 
block 60 in Fig. 11a, and are based on the following 
inputted data: 
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(a) obstacle parameters, particularly the range 
and angle of the obstacle detected by the two 

sensor 3, 4; 

(b) probability/quality of detection; 

(c) uncertainty of the values of the parameters; 
and 

(d) position, attitude, velocity, and angularveloc- 
ity of the aircraft as inputted via the aircraft iner- 
tial navigation system 10. 

The signal processing system 8 then establishes 
an object/obstacles potential table, as illustrated at 
62 in Fig. 11b, based on all the object parameters and 
the direction of flight. This table classifies each of the 
detected objects 1 — n, according to the following 
classifications: 

R - range of the object; 

y - attitude/orientation of the object with re- 
spect to direction of flight; 

P - probability of collision with the object; 

Q - quality of decision 
From table 62, the system knows how to classify 
and to give priorities to the obstacles with respect to 
the flight direction. 

The data from the aircraft inertial navigation sys- 
tem 10 enables the signal processing system 8 to 
generate, from table 62, three additional tables as il- 
lustrated in Fig. 12 that partition the data of table 62 
into three categories, as follows: (a) table 62a, parti- 
tioned according to the ranges of all the objects in- 
cluded in the semi-sphere with radius R, which is a 
predetermined value based on flight conditions; (b) 
table 62b, partitioned according to the "time-to-go" 
(tgo), or time to collision if the aircraft continues in the 
same flight direction and at the same velocity; and (c) 
table 62c illustrating the most dangerous object re- 
flected by the two tables 62a and 62b. 

The Alarm Decision System 12 

As indicated earlier, the alarm decision system 
12 includes a video image generator 121 (Fig. 2) 
which receives the 3-D composite range- intensity im- 
ages of the protected region from the signal process- 
ing system 8, and also a logic decision block 122 
which determines the presence of at least one object 
which represents a danger to the protected aircraft. 
The logic decision block 122 in turn controls the video 
image generator 121, the aircraft displays 142 in the 
audio visual alarm system 14, and the obstacle map 
generator 161 in the gukjance command generator 
system 16. 

Fig. 1 3 is a flow chart illustrating the operation of 
the alarm decision system 12. 

The input to system 12 is a list of objects in the 
protected region which represent present or future 
dangers to the protected aircraft as detected by the 
signal processing system 8. This list contains infor- 
mation concerning the range to the obstacle, as well 



as tgo (time- to-go) at the current velocity and heading 
to a collision with the respective obstacle. 

The alarm decision system 12 first decides 
whether the list "L" is empty (block 70). If so, this 
5 means that there is no object present in the protected 
regbn. Accordingly, no alarm is generated (block 71), 
and there is nothing to display to the pilot. 

If the list L has at least one element, the list is sort- 
ed according to the range to the obstacles (block 72); 
10 and the objects are displayed to the pilot (block 73) 
as detected by the signal processing system 8 with no 
emphasis as to the level of danger represented by the 
obstacle. 

The list sorted by range is then tested for the ex- 
15 istence of objects belonging to a semi-sphere of ra- 
dius R, where R is calculated according to the maxi- 
mum measurement range of the sensor, taking into 
account measurement uncertainty factors. If there is 
no object in the semi- sphere defined by R, no alarm 
20 status is generated (block 74a), and the decision 
process is restarted from the beginning while the 
tracking process continues. If there are objects at 
range less than R, they are tested for closer ranges 
to the aircraft. 

25 If there is no obstacle closer than R^jn (block 

74b), an alarm condition (No. 1) is generated (block 
75) and is displayed (block 76). Rmin is calculated from 
dynamic parameters, e.g., maximum acceleration 
(^max) 3nd maximum velocity (V^ax) of the aircraft, 

30 such that if the aircraft moves at a^ax ^rid Vmax» col- 
lision could occur until the next position update of the 
aircraft inertial navigation system 10. If there are no 
objects closer than R^m, the objects inside the ball R 
are highlighted onto the display as yellow features by 

35 box 76. 

If there are objects at ranges smaller than R^jn, 
they are sorted according to tgo (time-to-go) until col- 
lision would occur when moving at the current veloc- 
ity and heading (box 78). A minimum time (t^in) is cal- 

40 culated (box 79) using the data from the aircraft iner- 
tial navigation system 10, including the current and 
maximum velocity and acceleration. If there are no 
objects with tgo less than a minimum time (block 80), 
an alarm condition (No.2) is generated (block 81), 

45 and those objects with tgo less than a minimum time 
tmin are highlighted on the display as green features. 

If there are obstacles with tgo less than t^in, an 
alarm condition No.3 is generated (block 83), and the 
obstacles are displayed as red features; the obstacle 

50 with minimum tgo is highlighted by blinking red (blocks 
84, 85). At the same time, an escape guidance com- 
mand is generated by the system 16 (block 86), and 
is displayed to the pilot in blinking red (block 87). 
The pilot is then asked for validation of the es- 

55 cape command (block 88). If the pilot validates the 
command, the guidance command is sent to the au- 
topilot (block 89); but if not, the command is cleared 
from the display. However, the obstacle with alarm 
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condition No.3 continues to be displayed as bl inlying 
red until the pilot changes the course manually. The 
Audio- Visual Alarm System 14 

Fig. 14 is a block diagram of the audio-visual 
alarm system 22. The inputs to this system are the 
alarm condition status generated by the alarm deci- 
sion system 12, the data generated bythe signal proc- 
essing system 8, and the flight commands outputted 
bythe guidance command generator system 16. In re- 
sponse to these inputs, the audio-visual alarm sys- 
tem 14 controls the alarm display to the pilot. 

The alarm condition status generated by the 
alarm decision system 1 2 is applied to a pilot warning 
signal generator 143, which transforms the logical 
alarm signals into audio signals and visual signals. 
The audio signals, such as beeps at variable frequen- 
cy, are applied to a speaker 144. The visual signals 
are of two types: (1) warning messages to be dis- 
played as warning signals and commands in aircraft 
display 142a, and (2) colored graphic features to be 
displayed in the aircraft moving map display 142b. 
Both of the latter displays are fed from an obstacle 
display generator 145 receiving the output of the pilot 
warning signal generator 143. The obstacle display 
generator 145 further controls the video image mixer 
141 in the audio-visual alarm system 14. 

The data from the signal processing system 8 is 
applied to a video image generator 146 and is trans- 
formed into a 2-D image which is also fed to the video 
image mixer 141. Mixer 141 combines the 2-D im- 
ages from the video image generator 146 with other 
displays 18 of the aircraft and with the artificial dis- 
plays generated by the obstacle display generator 
145. The latter generator 145 generates yellow, green 
and red contours of the obstacles corresponding to 
the different alarm condition levels, and emphasizes 
the features generated by the video image generator 
121. The resulting 2-D composite image and color 
features generated by the video image mixer 141 are 
displayed to the pilot in the display 142a. This display 
also includes the suitable warning messages gener- 
ated by the obstacle display generator 145, and the 
flight commands generated by the guidance com- 
mand generator system 16. 

Fig. 15 illustrates, at 150, the format of the im- 
ages displayed in the display 142a. The obstacle im- 
age represents a sub-frame of the size of the dimen- 
sions of the HFOV (horizontal field of view) x VFOV 
(vertical field of view) on the screen of the display 
142a. The obstacles can be the cables Ci, C2 as 
shown at 151 and 152, respectively, and/or terrain 
features as shown at 153. They are represented by 
their actual positions in the form of solid lines, and in- 
clude an uncertainty region, as indicated by broken 
lines 1 51 a, 1 52a and 1 53a, respectively, around them 
because of measurement noise. 

Each obstacle is associated with a point Oa, Ob 
and Oc, respectively, representing the closest point of 



the obstacle to the aircraft. Each obstacle further in- 
cludes a message box, as shown at 151b, 152b and 
153b, respectively, containing the range to the re- 
spective point Oa, Ob, Oc, and the angles AZ (azi- 

5 muth) and EL (elevation) between the pilot line-of- 
sight (21, Fig. 3) and the marking 22 (Fig. 1) on the 
panel display and the position of the respective point 
Oa, Ob, Oq- The message box 151b, 152b, 153b, as- 
sociated with an obstacle is colored according to its 

10 alarm status. 

If the aircraft is equipped with a moving map dis- 
play (142b, Fig. 14), commonly provided in helicop- 
ters, the obstacle display generator 145 produces an 
artificial dynamic moving image to the moving map 

15 display, indicating the horizontal projection of the ob- 
stacles onto the moving map. Fig. 16 illustrates such 
a display image. The moving map displayed, gener- 
ally indicated at 170, in the moving map display 142a 
contains terrain elevation contours 171, aircraft 

20 heading 172, mapped high power line cables 173, 
geographical information data, and other features, as 
introduced by the digital terrain map 44 (Fig. 8). The 
obstacle display generator 145 (Fig. 14) generates 
images of detected obstacles, as shown at 174, un- 

25 certainty regions 1 75, the horizontal projection 1 76 of 
the protected region (20, Fig. 4), and estimated cable 
positions at 1 77. The cables are represented by solid 
lines whose colors correspond to their alarm status. 

30 The Guidance Command Generator System 16 

Fig. 17 is a block diagram illustrating the guid- 
ance command generatorsystem 16. As shown in Fig. 
2, this system includes an obstacle map generator 

35 161 which receives the following inputs: (1) the range 
and orientation of the obstacles, from the signal proc- 
essing system 8; (2) the aircraft velocity and body an- 
gles from the aircraft inertial navigation system 10; 
and (3) the warning level signals, from the alarm de- 

40 cision system 12. The obstacle map generator 161 
calculates, from the foregoing inputs, the escape 
path, namely the 3-D escape trajectory for the aircraft 
to follow in order to avoid the obstacle. This escape 
path is applied to the aircraft displays 142 for viewing 

45 by the pilot. 

The obstacle map generator system 16 also gen- 
erates, at the same time, the flight guidance acceler- 
ation commands applied to the obstacle avoiding 
command generator 162 for controlling the aircraft 

50 autopilot. However, as described earlier particularly 
with respect to the flow chart of Fig. 13, this control 
of the autopilot requires first the validation of the 
commands by the pi lot before such commands can be 
executed. 

55 Fig. 18 illustrates an example of how an escape 

path is generated by generator 161 and displayed in 
the aircraft display 142. In Fig. 1 8, the current velocity 
and heading of the aircraft is represented by the vec- 
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tor V. The collision point Cp lies on the line defined by 
the vector V at a range which takes Into account the 
response time of the pilot and measurement errors; 
that is, the response time multiplied by V is less than 
the range to the cable, i.e., OCp. The orientation of the 
cable with respect to the heading direction of the air- 
craft is indicated as p. Rp is the safety distance be- 
tween the aircraft and the cable at the actual velocity 
V. 

The escape path (EP) computed by the obstacle 
map generator 161 (Fig. 17) is indicated as EP and is 
tangent to the velocity vector V at the current position. 
It is also tangent to a line parallel to the cable at dis- 
tance Rp from it at a point P on its trajectory further 
than the point Q of intersection between the line per- 
pendicular to the cable at Cp and the trajectory. The 
obstacle is placed at such a distance to enable the air- 
craft to move on a given trajectory EP at maximum 
acceleration and velocity. The alarm decision system 
12 is designed such that tf^m and R^\n stand for the 
previous condition. 

While the invention has been described with re- 
spect to one preferred embodiment, it will be appre- 
ciated that this is set forth merely for purposes of ex- 
ample, and that many other variations, modifications 
and applications of the invention may be made. 



Claims 

1 . Airborne obstacle collision avoidance apparatus, 
comprising: 

(a) object sensor means for sensing objects 
within a field of view of the aircraft; 

(b) an aircraft navigation system for navigat- 
ing the aircraft through space; 

(c) signal processing means for receiving data 
from both the object sensor means and the 
aircraft navigation system, for generating 
map data of the objects within the field of view 
of the aircraft, for dynamically changing said 
map data as the aircraft moves through 
space, and for determining the probability 
that the aircraft is on a collision course with re- 
spect to each sensed object; and 

(d) alarm means for producing an alarm when 
said signal processing means determines 
there is a high probability that the current air- 
craft flight direction is on a collision course 
with respect to a sensed object. 

2. The apparatus according to Claim 1, wherein 
said aircraft navigation system is an inertial nav- 
igation system. 

3. The apparatus according to Claim 1, wherein 
said alarm means includes a visual display, and 
display control means for visually displaying 



thereon the sensed objects and an indication of 
their probabilities of being located on a collision 
course with respect to the current flight direction 
of the aircraft. 

5 

4. The apparatus according to Claim 3, wherein 
said display control means visually displays: 

(i) in a first color, objects at a relatively large 
distance from the aircraft; 
10 (ii) in a second color, objects that will become 

a danger of collision if no corrective action is 
taken; and 

(ill) in a third color, objects which represent a 
danger to the aircraft and require corrective 
15 action. 

5. The apparatus according to Claim 4, wherein 
said signal processing means causes the display 
of said third color to blink with respect to objects 

20 which immediately require a corrective action to 

avoid a collision. 

6. The apparatus according to Claim 5, wherein 
said alarm means also includes a speaker for 

25 sounding an audio alarm when an object of said 

third color is caused to blink. 

7. The apparatus according to Claim 3, wherein 
said display control means also visually displays 

30 the range of each detected object having a high 

probability of being located on a collision course 
with respect to the current flight direction. 

8. The apparatus according to Claim 7, wherein 
35 said display control means also visually displays 

the azimuth and elevation, with respect to the 
current flight direction, of each detected object 
having a high probability of being located on a 
collision course with respect to the current flight 
40 direction. 

9- The apparatus according to Claim 3, wherein 
said display control means displays, in full lines, 
the sensed objects having a high probability of 
45 being located on a collision course with respect 

to the current flight direction, and in broken lines, 
spaced at a distance from said full lines of said 
sensed objects, an uncertainty region caused by 
measurement noise. 

50 

10. The apparatus according to Claims 1, further in- 
cluding guidance command generator means for 
generating an emergency escape flight guidance 
path, and for displaying said path to the pilot, in 
55 the event said signal processing means determi- 

nes there is a danger of an imminent collision with 
an object. 
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11. The apparatus according to Claim 10, wherein 
said aircraft includes an autopilot, and said guid- 
ance connmand generator means also generates 
emergency escape f I ight gu idance commands for 
execution by the autopilot if validated by the pilot. 5 

12. The apparatus according to Claim 1, wherein 
said signal processing means processes said 
map data to establish a table classifying each de- 
tected object accordi ng to the range of the object, io 
altitude of the object with respect to the flight di- 
rection, probability of collision with the object, 

and quality of decision. 

13. The apparatus according to Claim 12, wherein 15 
said signal processing means generates, from 

the data in said table, three additional sub-tables 
that partition the data at least according to the fol- 
lowing: 

(A) a first sub-table, according to the ranges 20 
of all the objects included within a semi- 
sphere having a predetermined radius with 

the aircraft as its center; 

(B) a second sub-table, according to the time- 
to- collision if the aircraft continues in the 25 
same flight directbn and at the same velocity; 

and 

(C) a third sub-table, illustrating the most dan- 
gerous object reflected by the other two sub- 
tables. 30 

14. The apparatus according to Claim 1, wherein 
said signal processing means further includes 
means for processing said map data to define the 
boundary between the ground and the flight 35 
space. 

15. The apparatus according to Claim 1, wherein 
said signal processing means further includes a 
straight line filter to extract, from said map data, 40 
straight line features in order to facilitate identi- 
fication of straight line obstacles, such as electric 
cables and electric poles. 

16. The apparatus according to Claim 1, wherein 45 
said obstacle sensor means includes an active 
electro-optical laser sensor measuring range and 
intensity. 

17. The apparatus according to Claim 1, wherein 50 
said obstacle sensor means includes an electro- 
magnetic cable sensor. 
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